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ABSTRACT 

An item classification scheme developed by A. M. 
Gallagher (1990) was refined, resulting in a more accurate prediction 
of sex differences in the mathematical sections of the Scholastic 
Aptitude Test (SAT). Differential Item Functioning (DIF) procedures 
for examinees scoring over 650 indicated that the majority of items 
favoring males required the use of mathematical insight, while all 
the items flagged as favoring females required standard algorithmic 
solutions. Structured interviews were conducted with 25 male and 22 
female high school juniors and seniors from the examinee group to 
study differences in strategy use. There was a substantial overlap in 
strategies used by males and females, but analysis across all items 
indicated that females were more likely than males to use algorithmic 
strategies, and males were more likely than females to use insightful 
strategies. Questionnaire data obtained from the students interviewed 
indicated a positive relationship for both males and females between 
SAT mathematical performance and positive attitudes toward 
mathematics. The use of algorithmic strategies was correlated with 
negative attitudes toward mathematics* Implications of these and 
other findings are discussed. Eleven tables present study findings. 
Four appendixes contain the following: (1) prototypical items for 
classification categories; (2) problems used for think-aloud 
protocols; (3) attitude and background questionnaire; and (4) 
background variables and correlations between SAT mathematics or 
strategy and questionnaire items. (Author/SLD) 
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ABSTRACT 

An item classification scheme developed by Gallagher 
(1990) was refined, resulting in a more accurate prediction 
of sex difterences in performance on the mathematical sec- 
tions of the College Board s Scholastic Aptitude Test (SAT). 
When Diftercntial Item Functioning (DIP) procedures were 
performed on item data for examinees scoring above 650, 
the majority of items that were flagged as favoring males 
required the use of mathematical inr»ight. whereas all the 
items flagged as favoring females required standard algo- 
rithmic solutions. 

Structured interviews were conducted with students 
(25 males and 22 females) in this score range to determine 
the nature of differences in strategy use. A classification 
scheme was developed for strategies that paralleled the item 
classification categories. There was substantial overlap in 
strategies used by males and females; however, analyses of 
strategy types used across all items indicated that females 
were more likely than males to use algorithmic strategies 
and males were more likely than females to use insightful 
strategies. It should be noted that these findings constitute a 
generalization across a group of subjects and items, and that 
there were several individual instances of males using more 
algorithmic strategies than females and females using more 
insightful strategies than males. 

Questionnaire data gathered from students who partici- 
pated in interviews indicated a positive relationship for both 
males and females between SAT-mathematical performance 
and positive attitudes toward mathematics (e.g., liking 
mathematics as a subject and recognizing its usefulness to 
their adult lives). The use of algorithmic strategies, how- 
ever, was correlated with negative attitudes toward mathe- 
matics (e.g., mathematics being difficult and not being rel- 
evant to their lives). Implications of these and other findings 
are discussed. 

INTRODUCTION 

Sex differences in mathematical performance are well doc- 
umented, though the hypothesized causes of these differ- 
ences are varied. To date, however, little work has been 
done that examines the specific nature of these differ- 
ences — exactly what males and females do differently on 
measures of mathematical performance. The research pre- 
sented here seeks to add to our understanding of the nature 
of sex differences in performance on standardized mathe- 
matics tests. 

Previous research has shown that males perform better 
than females on the mathematical sections of many stan- 
dardized achievement tests administered to adolescents. Al- 
though some studies have found that the size of average dif- 
ferences is small, relatively large differences (of about half 
a standard deviation) have been found among high achiev- 
ing students (Benbow and Stanley 1980; Feingold 1988; 



Hyde, Fennema. and Lamon 1990). Research findings gen- 
erally conclude that sex differences in mathematical per- 
formance occur among adolescent and adult populations but 
not among younger groups (Maccoby and Jacklin 1974; 
Hyde. Fennema, and Lamon 1990). These differences have 
been found on standardized tests but not in mathematics 
grades (Clark and Grandy 1984). 

Recent efforts to examine sex diflcrences in mathemat- 
ical performance have attempted to validate hypotheses con- 
cerning the origins of the observed differences. Many of the 
studies examining the effects of background on mathemati- 
cal performance have focused on the relation between sex 
and courses taken. It is well documented that males take 
niorc mathematics courses than females (Armstrong 1981; 
Benbow and Stanley 1982; Fennema and Sherman 1977). 
Several studies have found that controlling for course-taking 
substantially reduces, but does not eliminate, sex differ- 
ences in performance on standardized teras (Bridgeman and 
Wendler 1990; Pallas and Alexander 1983). 

Studies frequently conclude nat differences in test per- 
formance are the result of differential performance on only 
certain types of items. Indeed, the bulk of the research sup- 
ports a dichotomy of item types: items that are well-defined 
and resenible material taught in school, versus items that are 
ill-defined and require insightful or unusual solution strate- 
gies, Armstrong (1985) and Dossey, Mullis. Lindquist. and 
Chambers ( 1 988) found that females outperform males on 
problems where the procedural rule is obvious, while males 
do belter when the problem-solving strategy is less clearly 
defined. This dichotomy can conceivably encompass the 
categorization of item types showing sex differences in per- 
formance in other studies: the pure mathematics/word prob- 
lem categorization (McPeek and Wild 1987; O'Neill, Wild, 
and McPeek 1989), the algebra/geometry categorization 
(Boswell 1985; Doolittle and Cleary 1987; Hudson 1986). 
and the algorithmic/strategic categorization (Doolittle 
1987). 

These results support hypotheses put forth by Kimball 
( 1989) in an effort to explain why females tend to get better 
grades than males in mathematics classes but show poorer 
performance on mathematics tests. Kimball suggests that 
differences in test performance may be the result of differ- 
ences in the way male and female students approach and 
solve problems. 

Results of an earlier statistical study performed on 
SAT-mathematical data (Gallagher 1990) indicated that 
high-scoring males and females may indeed be using differ- 
ent solution strategies on SAT-mathematical items. In that 
study, a taxonomy was developed to classify mathematics 
items on three forms of the SAT on the basis of strategies 
that could be used in their solution. When Differential Item 
Functioning (DIF) procedures were performed on the item 
data for examinees scoring 650 or above, significantly more 
items requiring insight or estimation were flagged in favor 
of males than items requiring the use of standard algo- 
rithms. When self-reported course-taking in math was con- 
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trolled, similar differences favoring males were found for 
the best-prepared group (examinees who had four years 
or more of high school mathematics, including some 
calculus). 

It is hypothesized by some researchers that these sex 
differences in the ability to apply mathematical principles 
to solve unfamiliar problems are the result of males' and 
females' different approaches to learning mathematics (Fen- 
nenia and Peterson 1985; Grieb and Easley 1984). Accord- 
ing to this hypothesis, the learning process for males is 
largely independent of procedures outlined in the class- 
room, whereas females rely substantially more on algo- 
rithms taught in class and procedures outlined by the 
teacher. According to Grieb and Easley (1984). autonomous 
learning exhibited by males allows them to develop their 
own solutions to problems without relying on the proce- 
dures and algorithms taught in class. Although this hypoth- 
esis presents a reasonable explanation for the differences, 
there is meager empirical evidence to support it. 

It appears, ihen. that sex differences in performance on 
standardized tests of mathematical ability are probably the 
result of a combination of background variables and difler- 
ences in approaches to problem solving and learning in 
mathematics. Males may possess a combination of charac- 
teristics that allows Jiem to outperform females on stan- 
dardized tests of mathematical problem solving but ibat 
does not generally give them an advantage on measures 
such as grades in mathematics courses. It appears that some 
of the observed differences in high-performing students can 
be accounted for by different strategies used by males and 
females to solve particular types of problems. 

To date researchers have not directly examined what 
males and females do on standardized tests that produces 
results contradictory to those provided by mathematics 



grades. Work examining performance on particular item 
types has identified content and format variables often as- 
sociated with sex differences in performance, but no study 
has documented how these variables interact with the oper- 
ations students actually use to solve mathematical prob- 
lems. The present study examines sex difiercnces in per- 
formance on SAT-mathematical items from the perspective 
that performance differences are the result of dift'erent strat- 
egies used by males and females to solve mathematical 
problems. 

The purpose of this study was to further our under- 
standing of performance differences on the SAT by fine- 
tuning the classification scheme for mathematics items 
developed by Gallagher ( 1990) in order to predict perform- 
ance among high-ability students more accurately. This 
study also sought to develop a classification scheme for 
problem-solvmg strategies that parallels the item classifica- 
tion scheme. The strategy classification scheme was used to 
examine student problem solving directly, thus providing a 
link between quantitative analyses of response data and em- 
pirical data on how students solve problems, f^inally. infor- 
mation on students' attitudes and academic and extracurri- 
cular activities was examined to detcrnime whether these 
were related to strategy use or performance on the SAT. 

The study consisted of three parts. Items were classi- 
fied and analyzed in the first part of the study In the second 
part, items that were identified as differentially functioning 
for males and females were presented to students, who 
solved them out loud during recorded interviews. These 
data were used to validate the item categories used in the 
analyses in Part 1 and to examine diflcrences in the types of 
strategies male and female students actually used. Part 3 in- 
volved analyzing the questionnaire data obtained from the 
students who participated in Part 2. 
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PART 1 : ITEM ANALYSIS 
Method 

The Miintcl-Hacns7cl DIF procedure was run on subjects 
scoring 630 or more tor (ivc I'orms of the SAT, Two types of 
DIF statistics were used to determine dlH'crenccs in item 
pert'onnance: the Manlel-Haens/el P-DIF (MH P-l)IF) and 
thcMantel-Haens/el D-DIImMH D-DIF). The P-DIF statis- 
tic, based on the normally distributed percent correct (P+ ) 
distribution, is more sensitive to diflerences in items of 
middle difliculty, where small dilVerences on the ability con- 
tinuum are equivalent to a larger area under the normal 
curve than diflerences at either end of the scale. The D-DIF 
statistic, on the other hand, is based on delta, which is a 
linear scale and is, therefore, more sensitive than P-DIF to 
ditVerenccs in items of high or low dilliculty 

Examinees in the DIF analyses were drawn from one 
administration of each of the five forms that were analyzed: 
May and November 1987. May and November 1988, and 
May 1989, All analyses were run on subjects who scored 
650 or above, which restricted the range of possible scores 
(o 150 points as opposed to the standard 6(K)-point range. 
This restriction of lange in scores was reflected in relatively 
sividll DIF values. Consequently a relatively small criterion 
value was used to identify dilterentially functioning items. 

Items were flagged if the MH D-DIF was greater than 
or equal to 0,5 and the MH P-DIF was at or above a com- 
parable level for that scale (.05), Although higher levels of 
the MH D-DIF (1,0 or higher) are used operanonally for 
flagging items on the SAT, a value of 0,5 or more is consid- 
ered appropriate Tor research purposes. Items were classi- 
fied and the average MH P-DIF and MH D-DIF statistics for 
item categories by sex were examined using an analysis of 
variance procedure. 

Item Classification 

Before any analyse** of the DIF statistics were conducted, 
items in the mathematical sections of the live form> of the 
SAT were classified according to the types of strategies thai 
could be cflicicntly used in their solution given the time con- 
straints of the test. The classification scheme developed by 
Gallagher ( 1990) was revised and the "item content" cate- 
gory was eliminated, since results of previous analyses in- 
dicated that there was no relationship between item content 
and performance by sex for high-scoring examinees. 

In order for this study to further our knowledge of 
problem- solving strategies used by high scorers on the SAT, 
it was important to have consistency in item classification 
across raters and across test forms. With this in mind, a re- 
iterative process was used to develop the category descrip- 
tions listed below. A "bottom-up" approach was used to de- 
velop new categories by grouping the flagged items from 
the live forms. Thirty items were flagged across the five 
forms in the DIF analyses. Twenty-five of these items as 
well as two items whose MH P-DIF values were slightly 



below the (lagging criterion (,047 and ,048 as opposed to 
.05) were used for this purpose. These items were selected 
for the development of the nev/ classification system be- 
cause the analysis of item responses provided with the DIF 
analyses indicated a substantial sex difference (5 percent or 
more) in the choice of a particular distract or or in omit rates. 

The first step in the process of developing new classi- 
fications was to examine the items to determine whether 
they could be classified according to common attributes. 
Items were first divided into two groups: items favoring 
males and items favoring females. These were then re- 
\ ie\ved, along with an analysis of the most common wrong 
answer selected by each sex, to determine whether they 
could be grouped into subsets based on strategies that were 
probably used in their solution. This task was performed 
with the assistance of a test developer (female) who has had 
extensive experience in teaching mathematics, writing 
mathematics items, and determining examinees' solution 
strategies on the basis of notations written in test booklets. 
The following categories resulted from this review: 

1, Items that do not require insight, but require fairly 
lengthy solutions (these items favored females). 

2, Items that are too time-consuming if solved by 
standard methods but that can be solved quickly 
with insight (these items favored males), 

3. Items for which a standard algorithm does not exist 
or that require an unusual application of a standard 
algorithm (these items favored males), 

4. Items on which female responses indicated a n'^s- 
application of a standard algorithm (these items fa- 
vored males). 

Next, the same items were reviewed by a male test de- 
veloper with similar background and experience to deter- 
mine whether there was consensus on the groupings. This 
revicv; resulted in two changes to the classification scheme; 
the elimination of the fourth category, since the hypothe- 
sized reason lor errors was too subjective, and the inclusion 
of estimation as a strategy. The following three categories 
resulted from this review: 

1, Questions that are most eflicientlv solved using a 
standard algorithmic strategy of the type generally 
taught in high school mathematics classes. 

2, Questions for which the use of a standard algorithm 
would be too time-consuming and that therefore re- 
quire the examinee to invent an estimation strategy, 

3, Questions that must be solved using a unique al- 
gorithm invented specifically for that problem 
using general mathematical principles. 

These three categories were then used to classify all the 
items on the five forms of the SAT, The two test developers 
who were involved in developing tiic categories classified 
the 300 items independently, and the percent agreement was 
calculated after all items were classified. Table I (first 
rating) shows that agreement ranged from 47 percent to 82 
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Table 1. Interratcr Agreement on Item Classifications 



f orm First Haling Second Raima, 



Ma\ I9«7 47 75 

Nov. 1987 7.^ ?S 

Ma\ I9«8 h2 (,7 

No\. 1988 73 85 

May 1989 82 77 



Table 2. Reliability of Final Item Classifications 



f'orm* 7( Agreement on Rvclassificaiion 



May 1987 93 

Nov. 1987 93 

Miiy 1988 93 

N()\ 1988 95 

May 1989 95 



'Hach form contains 00 iicms. 



percent, with greater than 70 percent agreement on three 
forms. 

The items on which the raters did not agree were re- 
viewed and the classification categories were revised again 
to include two additional attributes: ( 1) specific mention of 
items that require the examinee to determine whether a re- 
lationship between two variables or equations is constant for 
all possible values of the variables, and (2) a distinction be- 
tween the insightful use of a standard algorithm and a 
unique algorithm created specifically for a particular prob- 
lem. The following four categories resulted from this final 
revision: 

1. Questions that can be answered only by primarily 
algorithmic methods. The method of solution is 
clearly defined. These items are examples of rou- 
tine textbook problems (type I). 

2. Questions that can be answered using a textbook- 
type algorithm but that may be solved more quickly 
using estimation or insight (type II). 

3. Questions that require an insightful use of an al- 
gorithm generally taught in school (type 111). 

4. Questions that are not generally found in textbooks 
and require the use of a unique algorithm devel- 
oped specifically for the problem. These questions 
may require consideration of all cases critical to 
satisfying given conditions. All items whose key is 
"It cannot be determined by the information given" 
fall in this category (type IV). 

Items on the five forms were reclassified using the new 
categories. As Table 1 (second rating) shows, the overall 
percent agreement between raters increased. Agreement 
across forms wa:; between 67 percent and 85 percent, with 
75 percent or greater agreement on four of the five forms. 
Items on which the raters disagreed were discussed again, 
and the raters reached consensus on all but six items (98 
percent agreement). The six items on which the raters did 
not agree were not classified. 

To test the reliability of the classification system, the 
raters were requested to reclassify the same items one 
month later. Agreement was between 93 and 95 percent (see 
Table 2). The 19 (out of 300) items for which classifications 
differed retained the classification assigned during the final 
session. To facilitate the use of the classification system in 



future research, examples of prototypical items from each 
category are piovided in Appendix A. 

Subjects 

Subjects for this part of the study were examinees who had 
recently taken one of the live forms of the SAT during a 
regular administration. The MH DI.F procedure was used to 
examine existing data in order to identify items on which 
males and females performed differently In order to employ 
this procedure it was necessary to match males and females 
on total SAT-mathematical scores. For example, males who 
received a score of 600 had to be compared v^^ith females 
who scored 600, On average, females' scores were lower 
than those of males. Therefore, the lower cutoff score for 
subjects in this part of the analysis was based on the fe- 
males' performance. Given the above requirements, the 
subject pool lor this analysis consisted of all examinees that 
were high school juniors or seniors, considered English to 
be their first language, and scored at or above the ninety- 
fifth percentile for female examinees. 

In addition, since previous analyses had shown that 
having taken calculus was related to SAT-mathematical 
scores (Gallagher 1990), only subjects who had taken cal- 
culus were used in the analyses. This information was ob- 
tained from the Student Descriptive Questionnaire (SDQ). 
The final sample, which drew subjects from all five forms, 
consisted of 67.887 males and 31,218 females. 

The recency of the calculus courses as well as the 
school in which they were taken were not addressed in this 
analysis. Although these two factors have been shown to 
have some effect on SAT-mathematical performance, this 
information is not provided by the SDQ. Since this part of 
the study relied on existing data, these two factors were not 
controlled. 

Results 

Item Location and Diffjculty 

The new classification scheme yielded a diflerent distribu- 
tion of item types across forms than was found in previous 
work (Gallagher 1990). Table 3 shows the frequency distri- 
butions of item types across all five test administrations for 
the new classification categories. Fifty-eight percent of the 
items were classified as type I. and types II through IV con- 
stituted 12 to 16 percent each. 
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Table 3. Frequency Distributions of New Item 'I^ pes 
across Five Test Administrations 



Ilcm Type 


Frequency 


</f uf'iiwi (rounded) 


! (ali'orilhni) 


175 


5K 


11 (nlgurithm or cs(irnution) 




1? 


Mi (inMjjhi with algonihm) 


4« 


U) 


IV (loi»ic or insighi only) 


.V) 


\2 


U nc lass i lied 


7 


4 



In kccpiny with (he lindings of Gallagher ( 1^)90), the 
present analysis indicated that type i items made up the ma- 
jority of the items at the beginning of each section. Indeed, 
70 percent of the items in the lirst half of each section were 
classified as type I, whereas only 46 percent of the items in 
the second half of each section were type I items. Item types 
III and IV were more frequently found in the second half of 
sections, and item type II was found about equally in both 
halves. Since item location in the SAT is delermined by dif- 
ficulty, one could conclude that for the total group of exam- 
inees at any given administration, items classified as type 
III or IV were generally more diflicult for the population of 
SAT takers than those classified as type I. 

High scorers in the present study follow a similar pat- 
tern. Fifty perceiu of all type III items and 33 percent of all 
type IV items had percent correct (P-f- ) values less than 0.8 
(less than 80 percent of the examinees answered correctly). 
In contrast, only 12 percent of type I and type II items had 
P + values below 0.8. Table 4 presents the mean P4- values 
for each type of item. Across the five forms, mean P + val- 
ues for type I and type II items are generally larger (indicat- 
ing that a greater proportion of the sample answered them 
correctly) than those for item types III and IV. An analysis 
of variance was run to determine whether any of these dif- 
ferences were significant. The asterisks in Table 4 indicate 
that the mean P + for item type I was significantly diflerem 
from the mean P+ for item types HI and IV. 

Sex Differences 

When the DIP analysis was run, a total of 30 items were 
flagged. All flagged items demonstrated a significant sex 
difference on the Mantel-Haenszel chi-.square test 



Tabic 5. Distribution of Flagged Items for High- 
Scoring Examinees 



Favored Sex 



hem Type 


Male 


Female 


Total 


1 


1 




10 


II 


(r 


0 


() 


III 


7 


t) 




IV 


7 


n 


7 


Total 


2\ 




M) 



{p < .001). Table 5 displays the distribution of items that 
were flagged favoring males or females. Nine of the 10 
flagged items classified as type 1 (standard algorithm) fa- 
vored females, and all the flagged items classified as types 
U, HI, and IV favored males. Significantly more items were 
flagged favoring males than females (binomial test 
/; < .05). The mean P4- values for flagged items favoring 
males and females were 0.68 and 0.73, respectively, This 
difi'ercnce was not significant. 

To ccunpare performance patterns in the high-scoring 
group with those of the average group, the preceding analy- 
ses were also performed on the total group of students who 
look the SAT during the five selected administralitins. Table 
6 displays the distribution of items flagged for the total 
group of examinees using the criterion described above. 
More type 1 items were flagged for the total group than for 
the high-scoring group, and the total number of items favor- 
ing males and temales is much more closely balanced in the 
total jzroup than in the high-sctiring group. Further, flagged 
items for the total group consisted of a different set of items 
than were flagged for the high-scoring group. However, the 
pattern of items favoring males and females within item cat- 
egories in the total group is similar to that of the high- 
scoring group; the tnajority of flagged type I items favored 
tetiiales, and the majority of flagged type II, III, and IV 
items favored males. These preliminary data suggest that 
some of the differences found among high scorers are also 
present amo' : students at lower levels. 

Table 7 presents mean MH P-DIF values across all 
items in the analysis of the high-scoring group. A one-way 
analysis of variance was run on the MH P-DIF values of the 



Table 4. Mean P+ Values for Item lypes and Test 
Administrations 

Ten Aciminisfraiion 
Item 



Type 


5iH7 


11 UV 


5fH}i 






Combined 


I 


.92 


.90 


.93 


.92 


.92 


.92 


11 


.93 


.85 


.80 


.94 


.94 


.89 


III 


.75 


.70 


.83 


.75 


.81 


.78* 


IV 


.84 


.82 


.87 


.85 


.85 


.84* 



♦Significantly different from type I (/j < .05). 



Table 6. Distribution of Flagged Items for Total Group 
of Examinees 



Favored Sex 



Item Type 


Afale 


Female 


Total 


I 


18 


21 


45 


II 


5 


1 


6 


HI 


4 


2 


6 


IV 


7 


1 


8 


Total 


34 


31 


65 
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Tabic 7, Mean Values of MH P-i)lF for Item lypes 



item Type Sftum* SP 



.(K)H(J (102 

II .Ol-U O.IM 

III Oim 0(M 
l\' .0205 0 04 



M\»sUi\c values iiuliciite thai loin.iloN were ^u^orl^l .iiul nciiausc \ allies 

iiklicatc thai males were !a\t>rcd. 

•*Sii»nilicamly ditlcrLMit trom all other tspcs (/> .(K)l ) 

300 items in (he live forms to dclcrniine whclhcr (here was 
a si^inilicanl cH'ccl amonu high scorers by ileni type. Sinee 
a huge proporiion of examinees correctly answerxi ihe ma- 
jority of the mathematics items, the P + values were gener- 
ally high. Therefore, the MH statistic was sclccied as 
the unit of analysis over the MM D-DIF statistic because it 
is the more conservative measure of DIh for items with high 
F+ values. A signilicant main etfect was found lor item 
type (F =^ 17.()f; /)- .(K)()l). Tukey's post hoc lesi 
showed signilicant difVercnees between type 1 items and all 
other item types. 

A mean cif 0 signifies that neither sex "s favored, a neg- 
ative inean favors males, and a positive mean favors fe- 
males. V^alues approaching ± 0.1 arc considered extreme. 
An examination of the means in Table 7 reveals that females 
performed better than males on type I iteni'^, and males per- 
formed better than females on types II, HI, and IV. Sex dif- 
ferences in performance on type 1 items were significantly 
ditferent from those on other item types. When these values 
are compared to Gallagher's (IW) mean MM P-I)IH val- 
ues, they are found to be more extreme and cluster more 
consistentbv by sex. 

Discussion 

The rclinenients made to the item classification scheme de- 
veloped by Gallagher (1990) produced a new classification 
scheme that was better able to distinguish between items 
that favor n^ales and those that favor females among high- 
scoring students. Using the refined scheme, the distribution 
of item types within each test section was similar to that 
found in the earlier study; item types 111 and IV were gen- 
erally placed at the end of a section, indicating that they 
were more diOicult. However, items that were flagged 
showed no significant difference in difficulty by item type. 
The distribution of items favoring males over females was 
also similar to that found in the earlier work; there were 
more than twice as many flagged items favoring males as 
those favoring females. 

The main difference between the classification scheme 
used by Gallagher (1990) and the refined version used in 
this study is in the proportion of items falling into each cat- 
egory (item type) and the mean MH P-DIF values for cate- 
gories. The refined scheme classified a greater proportion of 
items as type 1 than the original version did (58 percent ver- 



sus 32 percent), and the MM P-DIF values clustered more 
consistently by sex. Mean values for item types were more 
extreme, and there was i significant difference between type 
I items that slightly favored females and type II, III. and IV 
items that favored males (o varying degrees. 

When the distribution of flagged items for the high- 
scoring group was compared with the distribution of items 
f lagged for the total grcnip, a number of similarities and dif- 
ferences were apparent. The two groups differed in the pro- 
portion of items that were flagged as favoring one sex over 
the other. In the total group* about the same number of items 
favored males as favored females. In contrast, manv more 
items favored males than favored females in the high- 
scoring group. The two groups also differed in the distribu- 
tion of llagged items across item categories. Many more 
type 1 items (algorithmic) were flagged for examinees in the 
total group than in the high-scoring group. Within item 
types, however, the ratio of items favoring males to those 
favoring females is similar. The majority of flagged type I 
items favored females, and the majority of flagged type M, 
Ml, and IV items favored males in both the total group and 
the high -scoring group. This suggests that problem -solving 
differences that appear to exist among high scorers might 
niso be found among examinees in lower score ranges. 



PART 2: PROTOCOL ANALYSIS 

Score differences found for high-ability students on the 
mathematical sections of ihc SAT usually favor males, bui 
results of the item analyses that control lor total SAT- 
mathematical score indicate that these differences are prob- 
ably due to differential performance on only certain types of 
items. The purpose of the second part of the study was to 
provide qualitative information that could clarify the find- 
ings of the statistical studies. High scorers on the SAT were 
interviewed to determine what strategies they were actually 
using on SAT- mathematical items. The hypothesis that dif- 
ferences in the performance of high-scoring males and fe- 
males could be accounted for, in part, by differences in the 
solution strategies they use was examined further Specifi- 
cally, it was hypothesized that females would be more likely 
than males to use standard applications oi" school-taught al- 
gorithms, and males would be more likely than females to 
invent nonstandard types of solution strategies. Results of 
the item analyses are consistent with this hypothesis, but 
they lend only indirect support. The protocol analyses that 
follow were performed to examine students* problem- 
solving strategies directly in an effort to document these dif- 
ferences in a small sample of students. 

Method 

Fifty-eight subjects were asked to think aloud while solving 
the four types of mathematical problems identified in the 
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item analysis. Think-aloud sessions were audiotaped. Ac- 
cording to Ericsson and Simon (1984), think-aloud proto- 
cols or concurrent verbal reports can be considered reliable 
data on subjects' thought processes. The authors state: 

Our examination of two of the most vigorous challenges to 
the usefulness of verbal reporting leaves intact our belief that 
such reports — especially concurrent reports ... of specific 
cognitive processes — provide powerful means for gaining in- 
forniadon about such processes. The concurrent report re- 
veals the sequence of information heeded by the subject with- 
out altering the cognitive process, (p. 30) 

Subjects 

Subjects for this part of the study were juniors and seniors 
from public and private high schools within half an hour's 
drive from Educational Testing Service (ETS) in central 
New Jersey. Students were recruited through mathematics 
teachers, department heads, or guidance counselors. The 
original sample of 58 was reduced to 47 due to failure of 
the recording device. The resulting sample consisted of 23 
males and 22 females whose SAT-mathematical scores were 
670 or above. This score represents approximately the 
ninety-fifth percentile for females in recent administrations 
of the test. Table 8 displays the distribution of SAT- 
mathematical scores for these subjects. 

Instruments 

The item set for the think-aloud protocols (Appendix B) 
consisted of 27 items flagged for sex differences in the DIP 
analysis. Twenty-two of these items were part of the group 
of items used to develop the item classification categories in 
the item analysis study. Items were selected on the basis of 
the size of the sex diti'erence and their level of difficulty 

The items were pilot tested on subjects who vere sim- 
ilar in age and mathematical ability to the subjects who 
would provide the protocols. Results of the pilot testing 
showed that most students were able to solve individual 
items in four minutes or less, and that the level of difficulty 
was appropriate for the group that had been selected. Items 
were administered in order of difficulty. Two easy items that 
were not scored were given as practice. 

Data Collection 

Students and their parents were requested to read and sign a 
consent form with a brief description of the research. The 
think-aloud protocols were collected on audiotape by a fe- 
male examiner at the subject's school either during school 
hours or after school. An empty classroom or office was 
used to keep distractions at a minimum and to ensure that 
audiotapes were intelligible. Problems were presented one 
at a time, each on a full sheet of paper, and subjects were 
encouraged to use the extra space for scratch. Problem 
sheets for each student were labeled and retained to aid in 
transcription of the protocols. Students were told that the 
research they were participating in sought to examine how 
high-scoring students solved mathematical problems on the 



Table 8. Distribution of SAT-M Scores by Sex 



Scon' 


Males 


Females 


670 


i) 




m) 


2 


- 


(m 




1 


7(K) 


1 


1 


710 


1 


4 


720 




4 


7.'^0 




! 


740 


2 




750 




2 


7()0 




I 


770 


1 


0 


7K0 


3 


1 


7^0 


1 


0 


8(K) 


2 


0 


Mean 


740 


720 



SAT. Subjects were instructed to read the following written 
instructions before the think-aloud sessions began: 

I am going to give you some math problems from the SAT. I 
would like you to do these problems in the same way you 
would if you were taking the SAT except I would like you to 
"think out -loud" while you solve them. Say everything that 
you arc thinking while you are getting your answer. 

You will have four minutes to do each problem. Please use the 
extra space on each page to write any notes or equations. The 
first two problems will be for practice. Remember, try to do 
the problems in exactly the same way you would if you were 
really taking the SAT. After you finish a problcni I will not 
tell you whether your answer is correct or not, but I may ask 
\ou to explain some more about how you got your answer. 
Do you have any questions? 

No other information was given to students before or during 
the interview. Interviews lasted from 40 minutes to an hour. 
Their duration depended on the amount of time available in 
the student's schedule and how quickly the problems were 
solved. The examiner intervened only in the following cir- 
cumstances: (I) If the subject paused for more than 30 sec- 
onds, the examiner asked, "What are you thinking?" (2) If 
the subject exceeded the time limit, the examiner informed 
him or her that the allotted time was up, (3) If the examiner 
was unable to understand how the subject solved the prob- 
lem, the subject was asked, "Can you tell me how you got 
that?" 

Strategy Ciassificatlon 

Strategy classification categories were developed in much 
the same way as the new item classification categories de- 
scribed earlier. Once all the think-aloud protocols were re- 
corded and transcribed, solutions were examined within 
each problem. Methods of solution for each problem were 
listed. This resulted in a list of up to 10 strategies for each 
problem. Next, solution strategies for all problems were 
compared to determine whether there were commonalities 
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across problems. The following eight categories of solu- 
tions were developed through this process: 

\ . Algorithm: Solutions that consist primarily of com- 
putational strategies generally taught in school. 
This includes computations and .algebraic formulas 
using abstract terms or givens from the problem 
stem. 

2. Insif^lu with algorithm: Solutions that use a math- 
ematical algorithm but are simplified or shortened 
due to insight, logical reasoning, or estimation. 
This category includes solutions for which the stu- 
dent realizes that it is not necessary to complete an 
equation or algorithm in order to choose an option. 

3. Loi^lc. estimation, or insight: Solutions based pri- 
marily on the application of mathematical prin- 
ciples or logic, either alone or in combination with 
estimation or insight. These solutions generally do 
not employ computations or algorithms, but they 
may include minor mental calculations. Solutions 
may require consideration of all cases critical to 
satisfying given conditions, 

4. Assigning values to variables: Solutions achieved 
by assigning values to variables given in the prob- 
lem stem. This includes trial -and -error solutions 
using random numbers and solutions for which as- 
signed values make operations more ''concrete," 

5. Plugging in options: Solutions found by working 
backwards from options, systematically plugging 
in choices. 

6. Guessing: Solutions based primarily on tiuessing. 
This includes choices that are based on surface 
characteristics of options or are unexplained (e.g., 
"it just looked right"). This category does not in- 
clude estimations based on partial solutions, 

7. No strategy: Examinee did not formulate a solution 
strategy. This category applies only to instances in 
which no attempt at solution was made (e.g., "I 
don't know how to do this"), it does not include 
items the examinee attempted but failed to solve. 

8. Misinterpretation: This category applies only to 
solutions for which the examinee clearly misread 
or misinterpreted the item stem or diagram. It does 
not include faulty solutions caused by misunder- 
standing or misuse of mathematical terms and con- 
cepts or unfmished solutions. 

Transcriptions of all solutions to each problem were 
coded by one rater using the eight categories li.sted above. 
If the subject changed strategy within a problem, more than 
one strategy was coded for that item, A second rater was 
then trained by the first rater to use t^e coding system. 
Training consisted of a review of the categories followed by 
a discussion of prototypical solutions to several problems. 
The second rater then practiced coding solutions on two 
problems. Ratings for solutions to these problems were then 
reviewed and discussed with the first rater. Finally, the sec- 



ond rater coded all solutions to 10 of the 27 problems that 
had not been specifically discussed with the first rater. The 
two problems used for practice coding were not included in 
the 10 problems. Coding by both raters was "blind" in that 
coders did not know the subject s sex. There was 82 percent 
agreement between the first and second raters. Disagree- 
ments were resolved through discussion to reach 100 per- 
cent agreement. 

Results 

Since the distribution of SAT-mathematical scores in this 
part of the study was somewhat higher for males than for 
females, two sets of analyses were run on the solution strat- 
egy data. The first set was run on the total group of 47 sub- 
jects. An additional set was run on a subsample of the total 
group {n = 28) in which males and females were matched 
on SAT-mathematical scores. 

Strategy Use 

Strategies used by students in the think-aloud protocols 
were categorized into one of the eight categories outlined 
above. Nine of the 27 items used in the think-aloud proto- 
cols were eliminated from the analyses becau.se the proto- 
cols provided little insight into the processes that students 
used to solve them. Seven of these items were "quantitative 
compari.son" items. Solutions to this item type consi.sted of 
either plugging actual values into the equations ( with no in- 
dication of how the values were selected) or simply choos- 
ing an. answer "because it has to be that way." Probing ex- 
aminees on their solution methods did not ameliorate this 
situation. Clearly other methods more specifically geared to 
quantitative comparison items must be used to determine 
the strategies students use to solve these items. 

The remaining pool of items consi.sted of 18 items: 9 
type I items, 4 type II items, 3 type III items, and 2 type IV 
items. Since the .statistical analyses (performed in the item 
analysis) found that only type I items (standard algorithm) 
were significantly different from all other types (which re- 
quire either insight or the application of a novel algorithm), 
most analy.ses were performed on only two groups of items: 
algorithm items (type I; /; = 9) and insight items (types II- 
\\\n = 9). 

Strategy categories can also be grouped into strategies 
that apply .standard algorithms and those that require in- 
sight. Strategy types 1 (applies a computational algorithm), 
4 (sub.stitutes values for variables), and 5 (works backwards 
from options) can all be grouped in an algorithm category, 
since they are all fairly standard computational strategies. 
Strategies 2 (insight with algorithm) and 3 (logic, estima- 
tion, or insight) can be grouped in an insight category, since 
they both require insight based on mathematical principles. 

When students changed solution strategies while solv- 
ing a particular item, multiple strategies were coded for that 
item. The incidence of multiple strategy use was fairly low, 
ranging from about 10 percent to 15 percent by item. How- 
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Table 9. Percent of Males and Females Responding Correctly by Item l^pe and Strategy Type for 
Total and Matched Groups 



Insight items 
(II. III. IV) 



Total Group 



5/ra/r,vy Type* 





/ 




2 








4 




.5 




6 






rithm** 


Insight 


♦ t 


Item Type 


M 




M 


F 


M 


F 


M 




M 


F 


M 


F 


M 


F 


M 


F 


I (algorithm) 


66 


75 


17 


8 


-i 


3 


11 


10 


3 


4 


0 


1 


81 


88 


19 


I 1 


II 


41 


38 


38 


42 


16 


13 


0 


0 


5 


6 


0 


0 


46 


44 


54 


56 


ill 


10 


21 


73 


41 


2 


0 


13 


21 


2 


14 


0 


0 


25 


56 


75 


41 


IV 


0 


0 


21 


27 


49 


43 


26 


27 


0 


0 


5 


3 


26 


27 


70 


70 



34 



64 



54 



Matched Group 



Strategy Type* 





/ 








4 




5 




6 




Alsiorithm** 




hem Type 


M 


F 


M 


F 


M 




M 


F 


M 


F 


M 


F 


M 


F 


M 


F 


I (algorithm) 


71 


79 


13 


8 


3 


1 


1 1 


8 


3 


4 


0 


0 


84 


91 


16 


9 


11 


44 


41 


33 


46 


1 1 


5 


0 


0 


1 1 


8 


0 


0 


56 


49 


44 


51 


III 


4 


23 


83 


39 


0 


0 


8 


22 


4 


17 


0 


0 


17 


61 


83 


39 


IV 


0 


0 


17 


30 


52 


50 


26 


20 


0 


0 


4 


0 


26 


20 


70 


80 



Insight items 
(IL III. IV) 



33 45 



63 



54 



♦Strategics 7 and 8 were excluded because they result in incorrect answers. 
♦♦Algorithm = strategics 1 . 4. and 5; insight = strategies 2 and 3; guessing 



strategy 6. 



ever, because it was possible that this could afiect the out- 
come, analyses were run on two sets of data: (1) all strat- 
egies that students used in solving problems, and (2) 
strategies that prcxiuced im answer — or final strategies. 
Results of the various analyses of both sets of data showed 
that multiple strategies had little effect on the outcome of 
the analyses. Therefore, results are reported only for the data 
set of final strategies. 

Item responses were examined using a Mantel- 
Haenszel chi-square to determine whether there were sex- 
related differences in the proportion of items answered cor- 
rectly. For the total group, the only significant difference in 
the ratio of correct to incorrect responses was found for in- 
sight items (types II, 111, and IV) [X^(l) = 5.7; p < ,02], 
where males responded correctly 80 percent of the time and 
females responded correctly 69 percent of the time. These 
results agree with the results of the statistical analyses that 
showed that females did better on algorithmic items (type I) 
and males outperformed females on insight items. 

In the matched group, females outperformed males 
across all item types 1X^(1) = 4.2; p < .05]. When the 
items were grouped it became clear that the females* supe- 
rior performance on algorithm items was the major contrib- 
utor to the difference in overall performance 
[X-(l) = 9.63; p < .01]. On type I items, females re- 
sponded correctly 81 percent of the time, and males re- 



sponded correctly only 62 percent of the time. There was no 
significant difference in performance on insight items. 

Strategy categories were examined to determine 
whether the students' strategies were those expected to be 
used based on the item classifications. Table 9 displays the 
percent of correct responses for the total and matched 
groups falling in the various strategy categories. When 
items and strategies are grouped into algorithm and insight 
categories, one can see that the majority of strategies 
used on algorithm items (type 1) were algorithmic strat- 
egies (1,4, and 5), and the majority of strategies used 
on insight items (types II~IV) were insightful strategies 
(2 and 3). 

In addition, the extent to which the model predicted 
strategies used on individual items was examined. Student 
records were analyzed lo determine whether the strategies 
they used were those that the model predicted they would 
use on specific items. According to the model, item type 
dictates which strategies will be used to find the solution. 
So type I items (algorithm) would be solved by both sexes 
using an algorithmic strategy, but type II items (algorithm 
or insight) would be solved by females using an algorithmic 
strategy and by males using an insightful strategy. Type III 
items (algorithm with insight) would be solved by both 
sexes in the same manner, as would type IV items (insight 
alone). 
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Table 10. Males and Females Using Predicted Strategy 
Types on Items 

Percent of Sitwcf^ies Predicted 



90— 












Sf)- 




_ 

S4-- 








S2- 




X()~ 




7«- 






>r\ \^', M;*. M*'. M**. F*'=. H**. F'* 


76- 




_ 




74-- 




- 




72- 


M'*, M*-, M*^ F'-. F-^^ F** 






70— 






M. M. M. F, F 


(>S- 






M. M, M. M. F. F 


(16- 






h 


(>4- 


M, F 


f>2- 


M 


hO— 




5H- 


V 


56- 


y 


54- 




52- 


M 


5{)~ 


F 



NiUo; Subfccis m ihe matched Jiroup arc underlined. 
7) - 0.01 
*7> 0.05 
'*-p 0. 1 

Since all subjects did not reach all items, the number 
of responses ranged from 10 to 18, The prediction rate 
ranged from a low of 50 percent (5 out of 1 0 items) to a high 
of 88 percent ( 14 out of 16 items), with the average rate of 
prediction for males and females being 73 percent and 71 
percent, respectively. Table 10 displays the percent "hit 
rate" for the model prediction of individual male and female 
strategies. A binomial test was conducted for each subject 
to determine whether the hit rate was better than chance. 
The hit rate was found to be significantly greater than 
chance for 15 of the 25 males (/; < .01 ) and 13 of the 22 
females (p < .01 ). 



The data also support the hypothesis that females are 
more likely than males to use algorithmic strategies even on 
items that require insight. This is most clearly seen in the 
grouped item and strategy categories. For the total group, 
feniales' use of algorithmic strategies was 8 percent greater 
than males' on algorithm items and 1 5 percent greater than 
males' on insight items. A Mantel-Haenszel chi-square test 
was used to determine whether these difl'erences were sig- 
nificant. The distribution of algorithmic and insightful strat- 
egies was significantly different for males and females on all 
items [X-(l) = 17.5: p< .001] and on insight items 
|X-(1) = 8.5; p < .01], The difference in strategy use for 
algorithm items was not significant for this group. 

The data for the matched group also showed females 
using algorithmic strategies more often than males on all 
item types. On algorithm items females used algorithmic 
strategies 16 percent more often than males, and on insight 
items females used algorithmic strategics 14 percent more 
often. The chi-squares indicated that these differences were 
significant for all items combined |X^(1) = 9.5: p < .01], 
as well as for algorithm items |X-( 1 ) = 5J: p < .02] and 
insight items |X-(1) = 4.1;/; < ,05]. 

Strategy use within subjects was also examined. Table 
1 1 shows the distribution of students by the percentage of 
problems solved using algorithmic strategies. Sixty percent 
of the females used algorithmic strategies at least 70 percent 
of the time, but fewer than one-quarter of the males used 
algorithmic strategies to this extent. Half of the males used 
algorithmic strategies on 50 percent or less of the problems, 
but only about or. tenth of the females fell into this cate- 
gory. Table 1 1 also indicates that some students tend to use 
primarily one type of strategy or the other; others seem to 
use both strategies fairly equally. 

Discussion 

An analysis of strategies used by high-scoring students on 
SAT-mathematical items supported the item categories de- 
veloped in the item analyses. Correct responses to items that 
were classified type I (requiring a standard algorithmic so- 
lution) were generated with standard solution strategies 
taught in school more than 80 percent of the time. Correct 
responses on items classified type II, 111, or IV (all contain- 
ing an insight component) tended to be produced with more 
unusual, insightful solution strategies. 

Further, these results indicate that there is a sex differ- 
ence in the way these high-scoring students solved particu- 
lar types of problems. In the analyses of the total group, 
significant differences were found in strategies used on both 
algorithm and insight items, where females were more 
likely to use algorithmic strategies than males. In keeping 
with the results of the item analysis, however, there was vir- 
tually no difference in the proportion of correct answers 
given on items requiring the application of standard strate- 
gies taught in school. The difference in performance ap- 
pears on items that require some type of insight or estima- 
tion, where males outperformed females. 
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Table 1 1 . Distribution of Subjects by Strategy Use 



of Problems Totnl Group Matched Group 



Solved w ith 
Aliiorithm 


Mfdes 


Females 




Females 


83 


0 
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I 
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1 


I 


1 


I 
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3 


5 


3 


4 


O / 


1 


•\ 
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I 
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3 


4 


I 


44 


3 


T 


1 


i 


39 


I 


I 


I) 


0 


33 


i 


1 


I 


0 


2t< . 




0 




0 



*lf examinees compleie all iiems, ihc model predjcis ihai temale«> would 
use 72 percent alcoriihmic Niraiegies and males would use 50 percent al- 
gorithmic strategies. 



In the matched group, perform anxe differences were in 
the same direction, except that females outperformed 
males. As in the total group, females tended to use algo- 
rithmic strategies more often than males on all item types. 
When performance differences were examined by 
item type, it became clear that the female advantage was 
gained on algorithm items, where there was a significant 
difference in performance, rather than on insight items. 
One can see that the paUerns for males and females in both 
the matched group and the total group are similar. Relative 
to the males, females did better on algorithm items and 
worse on insight items. Conversely, relative to females, 
males did better on insight items and worse on algorithm 
items. 

PART 3: ANALYSIS OF QUESTIONNAIRE 
DATA 

Students who participated in the protocol analysis study 
were given a questionnaire at the end of each think-aloud 
session. The purpose of collecting the questionnaire data 
was to determine whether there was a relationship among 
high-scoring examinees' performance on the SAT, the types 
of strategies they used, their attitudes toward mathematics, 
their test-taking strategies, and their academic and extracur- 
ricular activities. 

Method 

The questionnaire (Appendix C) was composed of three 
sections: ( 1) a section regarding altitudes toward mathemat- 
ics, based on Fennema and Sherman's ( 1976) Mathematics 
Attitude Scale: (2) a list of items describing various test- 
taking strategics; and (3) questions taken from the Student 
Descriptive Questionnaire (SDQ) for the SAT Question- 
naires were given to students at the end of think-aloud inter- 
views. Each student was asked to complete the question- 
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naire during free time and return it in a self-addressed 
postage-paid envelope that was provided. 

Statistical analyses were run to determine the relation- 
ship between questionnaire items and students' SAT- 
mathematical scores. In addition, analyses were run to 
determine whether questionnaire items were related to the 
students' problem-solving strategies used during think- 
aloud sessions. This was done by correlating questionnaire 
responses with the percent of strategies each student used 
that were algorithmic (i.e., strategy I solutions). 

Results 

The return rate for questionnaires was high, Seventy-six 
percent of the students interviewed completed and returned 
the questionnaire. Of the 58 students that were interviewed, 
21 females and 23 males returned completed question- 
naires. Appendix D provides details of students' back- 
ground and individual questionnaire items correlating with 
SAT- mathematical performance and use of algorithmic 
strategies. 

The majority of the questionnaire respondents were 
white (70 percent) 17-year-old t\\elfth graders (73 percent). 
Most of them had taken the SAT within the last year (91 
percent), and most had taken it twice (59 percent). These 
students generally prepared for the SAT on their own, 
studying at home rather than taking test preparation courses 
at school or elsewhere (68 percent). Most students rated 
themselves as being in the highest 10 percent in mathemati- 
cal ability (86 percent) and at least above average in science 
(84 percent) and writing ability (77 percent). Students gen- 
erally reported that both of their parents held a bachelor's or 
graduate degree (95 percent of fathers and 82 percent of 
mothers) and that their family income was generally greater 
than 570,000 (60 percent). First choices for college major 
were spread over 14 different fields, with the most popular 
choices for females being economics, banking, or business 
in = 5) and English or creative writing (// = 3). The most 
popular choice *of major for males was engineering 
in = 5). Finally, half of the students responded that they 
planned to complete degrees at the doctoral level. 

When Pearson product-moment correlations were run, 
different items showed significant correlations with SAT- 
mathematical performance and algorithmic strategy use (see 
Appendix D for specific items and correlation coefficients). 
The magnitude of correlations was moderate, ranging from 
.37 to .76. For the total group of respondents, correlations 
indicated a positive relationship between performance on 
the SAT and self-confidence i^^ mathematics and a liking for 
the subject. Other factors that correlated positively with 
SAT-mathematical performance were persistence in solving 
problems and the strategy of leaving several problems un- 
answered. Factors that correlated negatively with SAT- 
mathematical performance for the total group were guess- 
ing, the notion that mathematical problems can always be 
solved quickly, and the number of high school English 
courses taken. 

11 
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When correlations were examined separately by sex, 
dift'erent items were significantly correlated with SAT- 
mathematical performance for males than for females. For 
males, persistence in solving mathematical problems, a 
sense that mathematics will be useful in adult life, and the 
strategy of leaving several items unanswered all correlated 
positively with SAT performance. Factors that were nega- 
tively correlated with SAT performance for males were 
guessing, years of foreign language study in high school, 
and years of participation in government or political activi- 
ties. Positive correlations were found for females between 
SAT-mathematical performance and liking mathematics as 
a subject and grades in English classes. Females' SAT- 
mathematical scores correlated negatively with the number 
of high school English and natural sciences courses taken. 

A diftcrent set of items correlated with the use of algo- 
rithmic strategies. For the total group, the use of algorithms 
correlated positively with students not wanting other stu- 
dents to know they did well in mathematics classes, ratings 
of mathematics as a difiicult subject, and belief that mathe- 
matics is not relevant to the student's life. In addition, the 
number of courses taken in high school mathematics corre- 
lated positively with the use of algorithms in the total group. 
Items that correlated negatively with the use of algorithms 
were statements about the usefulness of mathematics, liking 
others to know they do well in mathematics, and the strat- 
egy of working a problem out before looking at the options. 

When correlations were run by sex, results for males 
showed positive correlations between the use of algorithms 
and the number of high school English courses and the num- 
ber of years studying algebra. Algorithmic strategy use in 
males also correlated with the notions that they did not like 
others to know they w^re good at mathematics and that girls 
who liked mathematics were a bit peculiar. The notion that 
mathematics is a useful subject to study correlated nega- 
tively with males' use of algorithms. 

For females, positive correlations were found between 
the use of algorithms and the notion that mathematics is dif- 
ficult and irrelevant to their lives, as well as the number of 
high school foreign language courses taken. Negative cor- 
relations for females were found between the use of algo- 
rithms and being thought of as smart in mathematics, work- 
ing a problem out first and then selecting from the options, 
and having taken a test preparation course outside of school . 

Discussion 

Although selection of the sample of students to be inter- 
viewed in the protocol analyses was not specifically geared 
toward obtaining a sample that was representative of all stu- 
dents who scored above 650 on the mathematical sections 
of the SAT, statistics for ethnicity, income, and parents' 
education for the group of students who were selected come 
fairly close to those of the total group of college-bound sen- 
iors who scored above 650 on the mathematical sections of 
the SAT in 1989 (Robertson 1990). High-scoring collegc- 
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bound seniors were 80 percent while as opposed to the pres- 
ent sample, which was 70 percent white. Seventy percent of 
the high-scoring population in 1989 reported that their fa- 
thers had received at least a bachelor's degree, as opposed 
to 95 percent of the current sample. Finally, a notable pro- 
porUon of high scorers from 1989 reported that their par- 
ents' income was above $70,000 (30 percent) as opposed to 
60 percent in the present group. The difference in this last 
factor can most likely be attributed to the limited geographic 
area from which the current sample was selected. 

Results of the questionnaire analyses indicate that, 
even among this high-scoring group, the students who do 
best on the SAT are those who like mathematics as a sub- 
ject, are confident in their mathematical ability, and feel that 
mathematics is a useful subject that is relevant to their pres- 
ent and future lives. These students also take fewer courses 
in verbal areas such as English and foreign languages. 

Fewer items correlated with SAT-mathematical per- 
formance when analyses were broken down by sex. It is 
likely that this is the result of the relatively small sample 
size. As one would expect, for both males and females, at- 
titudes that related positively to SAT- mathematical per- 
formance were attitudes that were positive toward mathe- 
matics: persistence in problem solving and the relevance of 
mathematics to adult life correlated positively for males, as 
did liking mathematics for females. Items that Cv)rrelated 
negatively were taking courses in verbal areas (English and 
foreign languages) or in natural sciences. 

It is interesting to note that many of the it^ms that dem- 
onstrated a positive relationship to the use of algorithmic 
strategies were items that indicated a negative attitude to- 
ward mathematics: that mathematics is difficult and not use- 
ful, and not wanting to be thought of as "smart" in mathe- 
matics. This suggests that students who have less affinity for 
mathematics are the ones who rely most heavily on algo- 
rithmic strategies; others who like the subject beUer and 
have more confidence are more likely to use more creative 
strategies. 

It is also interesting that algorithmic strategy use cor- 
related positively with both the number of courses taken in 
verbal areas such as English and foreign languages and the 
number of courses taken in mathematics, and that SAT- 
mathematical performance did not correlate positively with 
either. 



CONCLUSIONS 

This study examined performance on mathematics items re- 
quiring different types of solution strategies in order to de- 
termine whether high-scoring males and females differed in 
their use of standard algorithms and insight. The results of 
these analyses help to clarify the nature of sex-related differ- 
ences in performance on the SAT. Findings described here 
offer direct support for the notion that at least a portion of 
the differences among high scorers can be attributed to dif- 



ferences in strategy use. Females in this group appear to 
depend more heavily than males on standard algorithmic 
strategies that are generally taught in the classroom; males 
are more apt to use insight in their solutions. In addition, 
the students (both male and female) who used more algo- 
rithmic strategies tended to rate mathematics as more diffi- 
cult and less relevant to their lives. 

The following discussion is restricted to high-ability 
students only. Hyde, Fennema, and Lamon's (1990) work 
indicates that performance differences are substantially 
larger in high-ability groups, suggesting that different fac- 
tors could be involved at various levels of the ability contin- 
uum. Although preliminary data from the comparison of 
item types ffagged for high scorers and the total group sug- 
gest that gender-related diff'crences in mathematics perfor- 
mance at upper score levels and for ihc average group may 
have some factors in common, the present study focused 
primarily on high-scoring students. For this reason, results 
of this study may not be generalized to other levels. In ad- 
dition, since items in the quantitative comparison formal 
were omitted from the analyses, results of this study do not 
apply to this type of item. The results of this study arc sum- 
marized below. 

Summary of Results 

The item classification scheme developed by Gallagher 
(1990) was refined, resulting in a more accurate prediction 
of sex diff'erences in performance on mathematical sections 
of the SAT. When DIF procedures were performed on item 
data for examinees scoring above 650, the majority of items 
that were flagged as favoring males required the use of 
mathematical insight, whereas all the items flagged as fa- 
voring females required standard algorithmic solutions. 
This supports the findings of previous work and the notion 
that males do better on items requiring insightful solutions 
and females tend to do better on items requiring standard 
algorithmic solutions. 

An analysis of item data using the revised item classi- 
fication scheme indicated that less than half of the items on 
the SAT require insight, but that these items are generally 
more difficult than items requiring the application of a stan- 
dard algorithm. It is interesting to note, however, that even 
though the items that favored females were generally easier 
than those favoring males, there was no significant differ- 
ence in the difficulty of items flagged as differentially favor- 
ing males and females. 

A classification scheme was developed for strategics 
that was parallel to the item classification categories. Solu- 
tion strategies were obtained from think-aloud protocols. 
Strategies were analyzed to determine whether students ac- 
tually used the types of strategics hypothesized in the item 
classification scheme. In general, the strategies used were 
of the type predicted. An analysis of strategy types sup- 
ported the notion that females are more likely than males to 
use standard algorithmic strategies, and males are more 
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likely than females to use insightful or novel solution strat- 
egies. 

Analyses of questionnaire data eliciting information 
about students' attitudes, test-taking strategics, and aca- 
demic and extracurricular activities indicated a positive re- 
lationship for both males and females between SAT- 
mathematical performance and positive attitudes toward 
mathematics (e.g., a liking for mathematics as a subject and 
recognizing that it will be useful in their adult lives). The 
use of algorithmic strategies, on the other hand, was posi- 
tively correlated with rather negative attitudes toward math- 
ematics (e.g., mathematics is difficult and not relevant to 
their adult lives). Few relationships were found between 
SAT-mathematical performance or strategies and academic 
and extracurricular activities. The only significant correla- 
tions were the negative relationships of English and foreign 
language courses to SAT-mathematical performance and the 
positive relationship between the use of algorithmic strate- 
gies and courses taken in mathematics, English, and foreign 
languages. 

Discussion 

The null results for item difficulty on flagged items in Part 1 
of the study combined with the sex differences found for 
strategies in Part 2 seem to support the differential .strategy 
notion. If males and females used essentially equivalent 
strategies but males were just better, then the diff'ercnce in 
performance would be related to item difficulty. The fact 
that differences in male and female performance were not 
related to item difficulty suggests that they are using differ- 
ent processes to solve the problems. 

Since females were more likely than males to use al- 
gorithmic solution strategies, which require the systematic 
application of rules or formulas, they tended to do some- 
what better than males on items that required this type of 
solution. An example of this is illustrated by problem 7 in 
Appendix B, on which females outperformed males. On 
this particular problem, most students counted units around 
the perimeter to determine which rectangle was larger. Fe- 
males tended to count out the perimeter of all rectangles, 
whereas males tended to count only a few. Males who got 
this item wrong generally did so because they did not sys- 
temafically count the perimeters of all rectangles; they 
counted only the perimeters of the rectangles that appeared 
to be the largest (e.g., B and C) and selected among them. 
So, on this particular item, those who were more thorough 
and consistently applied the counting algorithm rather than 
looking for shortcuts had an advantage. 

Problem 12 in Appendix B is an example of a problem 
for which use of insight provides an advantage. There arc 
two ways to solve this problem: using a computational strat- 
egy or using a logical strategy. The computational strategy 
is fairly complex and requires some time and effort to set up 
equations; indeed, many who chose this strategy failed to 
set up equations that worked. Using logic, however, one can 
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see that more than half of the mixture must be the cheaper 
coffee (espresso), since the price per pound for the mixture 
is less than half the sum of the price per pound of each type. 
Using this information, there is only one possible option 
that could be correct, since all the others are greater than 25 
(or half of the 50 pounds of the mixture). On this type of 
problem, students who tended to look for shortcuts using 
their knowledge of mathematical principles had an advan- 
tage; they saved the time it would take to set up and solve 
the equations and avoided the pitfalls of extensive compu- 
tation. 

The sex-related differences in solution strategies that 
were found here provide insight into the discrepancy 
between mathematics test scores and class grades. If 
classroom-based tests require the application of solution 
strategies that have been taught (familiar, well-defined strat- 
egies), then students who arc more apt to spontaneously use 
these strategies (females) will outperform students who are 
less likely to use them. On the other hand, standardized 
tests that contain items whose solutions have not been ex- 
plicitly taught would yield differences favoring males, who 
are more apt to use less conventional solution strategies. 

The diiferences in solution strategies found here also 
suggest that differences in self-confidence that have been 
found in previous work could hold true for this group of 
subjects as well. The fact that females spent more time solv- 
ing problems and were more likely to use school-taught 
algorithms over more insightful methods reflects a more 
conservative approach that could be bom of a lack of self- 
confidence. Indeed, correlations between strategy use and 
questionnaire data on attitudes indicate that for the group of 
subjects interviewed, those who used algorithms most fre- 
quently found mathematics to be a ditiicult subject that had 
little relevance to their lives. The approach that many males 
take, on the other hand, relies more heavily on insight or 
estimation. Confidence in one's own ability could lead a stu- 
dent to use these types of shortcut strategies that ultimately 
require less time and effort. 

Several hypotheses speculate on the origins of these 
sex differences. Both the autonomous learning behavior hy- 
pothesis and the novelty/familiarity hypotheses reviewed by 
Kimball (1989) provide reasonable explanations for the dif- 
ferences in strategy use found here. Although there is little 
or no empirical evidence for these hypotheses, they suggest 
that mathematics teachers might be able to influence how 
students go about solving problems. 

According to these two hypotheses, females are more 
likely than males to use solution strategies provided by the 
teacher and, as a result, are less likely to do well on novel 
item types for which they have not learned a specific solu- 
tion strategy. If these theories are correct, then teachers can 
help reduce differences in the ways students solve problems 
by discussing several different ways of solving problems 
and by introducing different types of problems. 

According to Professional Standards for Teaching 
Mathematics, recently published by the National Council of 
Teachers of Mathematics (NCTM 1991), the goal of teach- 



ing is to help students develop "mathematical power." The 
NCTM defines mathematical power as: 

the ability to explore, conjecture, and reason logically; to 
solve nonroutine problems; to communicate about and 
through mathematics: and to connect ideas within nialheniat- 
ics and between mathematic and other intellectual activity. 
Mathematical power also involves the development of per- 
sonal .self-confidence and a disposition to seek, evaluate, and 
use quantitative and spatial intbrniaiion in solving problems 
and in making decisions. Students' f1exibilit>, perseverance, 
interest, curiosity and inventiveness also aflect the realization 
of mathematical power, (p. 1 ) 

All these characteristics would contribute to increased per- 
formance on items requiring unusual solution strategies and 
to an increased understanding of the relevance of mathemat- 
ics to other areas of one's life. 

The NCTM also notes that current teaching practices 
often do not foster these types of abilities in students. It sug- 
gests that several shifts in the environment of the mathemat- 
ics classroom need to take place in order for all students to 
be able to develop mathematical power. Four of the five rec- 
ommended shifts appear to relate directly to the differences 
in problem solving found in the current study: 

1. Toward logic and mathematical evidence as verifi- 
cation — away from the teacher as the sole authority 
for right answers. 

2. Toward mathematical reasoning — away from 
merely memorizing procedures. 

3. Toward conjecturing, inventing, and problem solv- 
ing — away from an emphasis on mechanistic an- 
swer linding. 

4. Toward connecting mathematics, its ideas, and its 
applications — away from treating mathematics as a 
body of isolated concepts and procedures. 

If the changes in the teaching of mathematics that are 
recommended in the NCTM standards can be implemented 
in most classrooms, it is possible that the types of sex differ- 
ences in problem solving that were found here will be 
greatly reduced. 

This report has not examined the cause of the differ- 
ences reporied,here. Hypotheses that speculate on the origin 
of sex differences in mathematics performance have been 
presented, and suggestions for changes in teaching strat- 
egies have been suggested. Differences in the use of 
problem-solving strategies in mathematics may be the result 
of a long sequence of events that afiect the sexes differently. 
High-scoring females, as a group, seem to be somewhat 
more conservative in their strategies, sticking to methods 
they were taught in school. This may be caused by a lack of 
confidence or interest, or because of the way they learned 
and think about mathematics. Factors such as these could 
conceivably be affected by changes in teaching strategies 
such as those recommended by the NCTM. Few studies to 
date have directly examined the impact of social learning on 
sex differences among high-ability students or how great an 
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cflcct socializalion has on these dilierences in mathematics. 
These questions and questions of how these differences can 
be eradicated need to be examined in future research. 

Suggestions for Future Research 

Many researchers have speculated on the origins of sex dif- 
ferences in iiiathemalics, but these theories lack empirical 
foundation. Future research should attempt to provide a link 
between speculations such as the autonomous learn i - hy- 
pothesis and empirical data, Before information concerning 
the nature of these differences in problem solving can be 
useful to educators, it will be necessary to link strategy dif- 
ferences to causal factors that might intluence change, Re- 
search needs to be done that will link strategy differences to 
other factors such as self-confidence or early learning that 
have been documented in the literature. 

Although the results of this study suggest that females 
are more likely to use standard algorithmic strategies and 
males are more likely to use insightful strategies, conclu- 
sions can be drawn only for high-ability groups. Further re- 
search is needed to determine whether this phenomenon 
exists at other ability levels and whether there are other, 
equally important differences that are more apparent at 
lower levels. 

One final note of caution in interpreting the findings of 
this study: Although sex ditlcrences in solution strategies 
were found, there was substantial overlap in the strategies 
used by both sexes. Results of any study examining cogni- 
tive ditTerences between the se.xes should be understood in 
the context of this overlap — as generalizations about fairly 
small ditVerences. In most cases, the overlap between the 
sexes is greater than the ditTerences between them. 
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APPENDIX A: PROTOTYPICAL ITEMS FOR ITEM CLASSIFICATION CATEGORIES 



Type I 

U n oranges cost,-? dollars, at this rate how many dollars 
will 5 oranges cost, in terms of n and p? 

(A) 5np 

(B) // 

(C) p 
5n 

(D) 5/1 
P 

(E) 5p 



= 12/:, and k i= 0, what is m + 



n i n terms of k'l 
(A) 3 



(B) k- 
3 

(C) W 

(D) 4/:^ + 12A- 

(E) 4W 

Type II 

Each plant of a certain variety yields 50 seeds in the early 
fall and then dies. Only 40 percent of these seeds produce 
plants the following summer and the remainder never pro- 
duce plants. At this rate, a single plant yielding seeds in 
1986 will produce how many plants as descendants in 1989? 



(A) 
(B) 



60 
400 



(C) 8,000 

(D) 16,000 

(E) 32,000 



A blend of cotfee is made by mixing Colombian coftce at 
$8 a pound with espresso coiVec at $3 a pound. If the blend 
is worth $5 a pound, how many pounds of the Colombian 
cortee are needed to make 50 pounds of the blend? 

(A) 20 

(B) 25 

(C) 30 

(D) 35 

(E) 40 

Type III 

Ms. Smith spent 20 percent of the money she had in her 
purse on lunch and 75 percent of what was left after lunch 
on groceries. If she then had $5.00 left, how much had she 
spent on lunch? 

(A) $10.00 

(B) $<S.50 

(C) $6.00 

(D) $5.00 

(E) $4.50 



SUMMARY 



DIRECTIONS FOR 
QUESTIONS 



COMPARISON 



An.swer; A if the quantity in Column A is greater: 
B if the quantity in Column B is greater; 
C if the two quantities are equal; 
D if the relationship cannot be determined 
from the information given. 



Column A 



Column B 



a + b ■ c = 15 
b -{^ c e = 2\ 
a + = 12 



The average (arithmetic mean) 

of a, h, c, and e 
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Type IV 

It' .V, |. y, I , and ' are integers, which ol ihe lollowing 
could NOT be a value of .v -f y -I- 

(A) 4 

(B) 3 

(C) I 

(D) -1 
(!•) -3 



B CD E 
P f 



0 



1 



On the number line above, which of the lettered arnms 
could be pointing to the product /; x /•? 

(A) A 

(B) B 

(C) C 

(D) D 
ili) E 



APPENDIX B: PROBLEMS USED FOR THINK- 
ALOUD PROTOCOLS 



SUiMMARY DIRECTIONS F^OR COMPARISON 
QUESTIONS 

Answer: A if the quantity in Column A is greater: 
B if the quantity in Cc^lumn B is greater; 
C if the two (juantities are equal; 
D if the relationship cannot be determined 
from the information given. 



2. (item type 1) 

If - IV - 4k\m - n ~ \2k, and k i-' 0. whaJ ism -f- 
// in terms of k'! 



(A) 



(B) A- 
3 

(C) 3A- 

(D) 4r + I2A' 
(H) 

3. (item type IV) 

-4 



B CD E 
P r 



0 



1 



On the number line above, which of the lettered arrt)ws 
could be pointing to the product /; x r? 

(A) A 

(B) B 
(Ci 

(D) /) 
ili) E 

4. (item type I) 

Mary's present age is half Paul's age. In 4 years. Paul will 
be /; years old. In terms of how old is Mary now? 



(A) ^ - 2 



(B) n 

(C) // 
2 

(D) n 



+ 4 



(E) 2// + 4 



1. (item type IV) 

Column A 



Column B 



6r < 7v 
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5. (item type I) 



7. (item type I) 



P Q R 

1 i i 

n n A 



\i PQ - QR on (lie luinihcr line above, what is tin: Icnt-th 
o\PR? 



(A) 



1 



(B) 1 

(C) I 



































1 












































A 


















P 


















































































































B 


















































C 
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SUMMARY DIRECTIONS FOR COMPARISON 
QUHSTIONS 

Answer: A if the quanlilv in Column A is greater; 
B if the quantity in Column B is greater; 
C if the two quantities are equal; 
D if the relationship cannot be determined 
from the information given. 



6. (item type IVj 
Column A 



Column B 



- \' > r > 0 



in the scale drawings above, each unit along the .v-axis rep- 
resents 2 meters and each unit on the y-axis represents 1 
meter. Which of the rectangles above represents the rectan- 
gle svith the greatest perimeter? 

(A) A 

(B) B 

(C) C 

(D) D 

(E) E 

8. (item type IV) 

ir V, \ y, \ r, and ^ are integers, which of the following 

' .V ■ y 2 
could NOT be a value of a" + y + 2'} 

(A) 4 

(B) 3 

(C) 1 

(D) -1 

(E) -3 
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9. (item type I) 



11. (item type I) 




Scgmcnls OA and OB, shown in the figure above, start on 
OX at the same time, and revolve simultaneously in the 
plane in opposite directions about point O, \WA revolves 
at 2° per second and OB revolves at 6*" per second, in how 
many seconds after tbey start will OA and OB first meet? 

(A) 22^ 

(B) 45 

(C) 50 

(D) 90 

(E) It cannot be determined f rom tbe information e'vcn. 
10. (item type 1 1 

In l\ABC, D is the midpoint o{ AC, and another point, Fi, 
is on AC such that BEx AC. Wbich ot the following must 
be true? 

(A) /.ABD - ^lDBC 

(B) 1 

^EBD - ^ ^lABC 
4 

(C) /.BAD = /_BDA 

(D) The length o{ AC > the length of BC 

(E) The lengtb of BD > the lengtb of BE 




in the figure above, lies on line segment MO. Which of 
the following gives v in terms of .v.'' 

(A) 2v 

(B) 2v + 5 

(C) 3.V + 5 

(D) 90 - X 

(E) 180 - 3.V 

12. (item type II) 

A blend of coflee is made by mixing Colombian coflcc at 
S8 a pound with espresso cofTcc at $3 a pound, if the blend 
is worth $5 a pound, how m.any pounds of the Colombian 
cofiee are needed to make 50 pounds of the blend? 

(A) 20 

(B) 25 

(C) 30 

(D) 35 

(E) 40 
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13. (item type I) 







1 





In the figure above, AC and AD are diameters of the small 
and large circles, respectively. U AB - BC = CD, what is 
the ratio of the area of the shaded region to the area of the 
smaller circle? 

(A) 1:1 

(B) 3 : 2 

(C) 4 : 3 

(D) 5:4 

(E) 9 : 4 

14. (item type IV) 

In plane R lines / and m are parallel to each other and are 6 
inches apart. How many lines in plane P are parallel to / 
and m and are twice as far from one of the two given lines 
as from the other? 

(A) None 

(B) One 

(C) Two 

(D) Four 

(E) More than four 



SUMMARY DIRECTIONS FOR COMPARISON 
QUESTIONS 

Answer: A if the quantity in Column A is greater; 
B if the quantity in Column B is greater; 
C if the two quantities are equal; 
D if the relationship cannot be determined 
from the information given. 



15. (item type IV) 

Column A 



X - 1 > 0 and .v - 1 < 0 



Column B 
0 



.V > 0 



Column B 

The average (arithmetic 
mean) of x and 2a- 



16. (item type IV) 

Column A 

The average (arithmetic 
mean) of .v, 2v, and 30 

17. (item type III) 

An airplane traveled a distance d in / hours, where r > K 
and arrived one hour late. The airplane would have arrived 
on time if it had traveled at what rate per hour? 

(A) r - 1 

(B) d 



- 1 



t 



(C) d ^ 
t 

(D) d 



t - 
(E) d 



t + 1 
18. (item type II) 



(3,10) 



(11,10) 



(3,2) 



(11,2) 



0 



In the figure above, a line segment joining the point (3. 10) 
and which of the following points on the square will sepa- 
rate the square into two regions whose areas arc in the ratio 
of 7 to 17 

(A) (11,3) 

(B) (11.4) 

(C) (11.6) 

(D) (11.7) 

(E) (11,8) 
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SUMMARY DIRECTIONS FOR COMPARISON 
QUESTIONS 

Answer: A if the quantity in Column A is greater: 
B if the quantity in Column B is greater: 
C if the two quantities are equal; 
D if the relationship cannot be determined 
from the information given. 

19. (item type III) 

Column A Column B 

a h c ^ 15 
+ + = 21 
a -\- e = 12 

The average (arithmetic mean) 7 
of a, b, i\ and c 

20. (item type I) 

If the average (arithmetic mean) of six numbers is - 6, and 
the sum of four of the numbers is 20, what is the average 
of the other two numbers? 

(A) 7 

(B) 8 

(C) -8 

(D) -28 

(E) -32 

21. (item type 111) 

Ms. Smith spent 20 percCiJt of the money she had in her 
purse on lunch and 75 percent .^f what was left after lunch 
on groceries. If she then had $5.00 left, how much had she 
spent on lunch? 

(A) $10.00 

(B) S8.50 

(C) $6.00 

(D) S5.00 

(E) S4.50 



22. (item type 11) 

Each plant of a certain variety yields 50 seeds in the early 
fall and then dies. Only 40 percent of these seeds produce 
plants the following summer and the remainder never pro- 
duce plants. At this rate, a single plant yielding seeds in 
1986 will produce how many plants as descendants in 
1989? 

(A) 60 

(B) 400 

(C) 8,000 

(D) 16,000 

(E) 32,000 

23. (item type I) 

If n oranges cost p dollars, at this rate how many dollars 
will 5 oranges cost, in terms of // and p? 

(A) 5np 

(B) n 
5p 

(C) p 
5/1 

(D) 5n 
P 

(E) 5p 
n 

24. (item type 11) 



X increased by 10% of x yields y. 
y decreased by 50% of y yields z. 
2 increased by 40% of z yields w. 



According to the statements above, )i- is what percent of .v^ 

(A) \Q7c 

(B) 339f 

(C) 779^ 

(D) 817r 

(E) lOO^'f 



SUMMARY DIRECTIONS FOR COMPARISON 
QUESTIONS 

Answer: A if the quantity in Column A is greater; 
B if the quantity in Column B is greater; 
C if the two quantities are equal; 
D if the relationship cannot be determined 
from the information given. 



SUMMARY DIRECTIONS FOR COMPARISON 
QUESTIONS 

Answer: A if the quantity in Column A is greater; 
B if the quantity in Column B is greater; 
C if the two quantities are equal; 
D if the relationship cannot be determined 
from the information given. 



25. (item type IV) 

Column A Column B 

Line segments RS and TU are parallel and have the same 
length. M is the midpoint of /?S. 

Length of MT Length of MU 

26. (item type III) 

The average (arithmetic mean) of 5 integers is greater than 

27. If the average of the first 4 integers is 22. what is the 
least possible value of the 5th integer? 

(A) 32 

(B) 33 

(C) 47 

(D) 48 

(E) 49 



27. (item type HI) 




4 



Column A Column B 

Points R Q, R, and S (not shown) are the centers of the four 
unshaded rectangular faces of the rectangular solid, 

The area of square PQRS 1 6 



APPENDIX C: ATTITUDE AND BACKGROUND QUESTIONNAIRE 

On the following pages is a series of statements. There are no correct answers for these statements. 
They have been set up in a way which permits you to indicate the extent to which you agree or disagree with 
the ideas expressed. Suppose the statement is: 

I like mathematics. 

As you read the statement, you will know whether you agree or disagree. Indicate the extent to which 
you agree or disagree with each statement by circling the appropriate number on the 5 point scale. The scale 
values are 1 strongly agree, 2 somewhat agree. 3 not certain, 4 somewhat disagree, and 5 strongly disagree. 

Do not spend much time with any statement, but be sure to answer every statement. 

There are no "right" or "wrong'' answers. The only correct responses are those that are true for you. 
Whenever possible, let the things that have happened to you help you make a choice. 



Test-taking Strategies for SAT-Math 
PLEASE CIRCLE A NUMBER WHICH BEST DESCRIBES YOUR RESPONSE. 



strongly strongly 
agree disagree 



Before I begin a section of the SAT I calculate the maximum amount of time 1 
can spend on each problem. If I don't get an answer in that amount of time I 
skip the problem i 2 3 4 
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2. I don't think about how much time I spend on each problem, I just try to go as 

quickly as I can 1 2 3 4 5 

3. 1 try to answer every problem as 1 come to it 1 2 3 4 5 

4. First I answer all the problems that look eas>', then I go back and do the harder 

ones I 2 3 4 5 

5. I usually have plenty of time to check any answers I am unsure about 1 2 3 4 5 

6. When I come to problems that look time consuming, I can usually find another I 
way to answer them that takes less time 1 2 3 4 5 . 

7. I always try to solve problems using formulas I learned in school 12345 i 

8. I usually answer all of the problems on the test 1 2 3 4 5 

9. I usually leave several problems unanswered 1 2 3 4 5 

10. 1 usually guess at the answer when I can eliminate one of the options 12345 

11. I only guess at the answer when I can eliminate three of the options 12345 

12. I don't ever guess 1 2 3 4 5 i 

13. I usually look at the options immediately after reading the problem 12345 | 

14. I usually try to work the problem out and then find an answer that matches ' 
mine 1 2 3 4 5 ^ 

15. I find it easier to solve SAT problems when I write down every step 12345 

16. I find it easier to solve most SAT problems in my head 1 2 3 4 5 

17. I always check my work even if it looks right 1 2 3 4 5 | 

18. i only check my work when something looks wrong 1 2 3 4 5 

Attitudes 

PLEASE CIRCLE A NUMBER WHICH BEST DESCRIBES YOUR RESPONSE. 

1. Generally I have felt secure about attempting mathematics 1 2 3 4 5 

2. I would expect a woman mathematician to be a masculine type of person 1 2 3 4 5 

3. I'll need mathematics for my future work 1 2 3 4 5 

4. I don't like people to think I'm smart in math 1 2 3 4 5 

5. 1 like math puzzles 1 2 3 4 5 

6. 1 am sure I could do advanced work in mathematics 1 2 3 4 5 

7. Mathematics is for men: arithmetic is for women 1 2 3 4 5 

8. Studying mathematics is just as appropriate for women as for men 1 2 3 4 5 

9. 1 study mathematics because 1 know how useful it is 1 2 3 4 5 

10. It wouldn't bother me at all to take more math courses 12 3 4 5 

11. Mathematics is enjoyable and stimulating to me 1 2 3 4 5 

12. In terms of my adult life it is not important for me to do well in mathematics in 

high school 1 2 3 4 5 

13. It*s hard to believe a female could be a genius in mathematics 1 2 3 4 5 

14. Girls who enjoy studying math are a bit peculiar 1 2 3 4 5 

15. I'd be happy to get top grades in mathematics 1 2 3 4 5 
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16. I would trust a woman just as much as I would trust a man to figure out important 

calculations 12 3 4 5 

17. Knowing mathematics will help me earn a living 1 2 3 4 5 

IS. 1 haven't usually worried about being able to solve math problems 1 2 3 4 5 

19. When a math problem arises that 1 can't immediately solve, I stick with it until I 

have the solution ^ ^ ^ ^ ^ 

20. Mathematics is of no relevance to my life 12 3 4 5 

21. I think ] could handle advanced mathematics 1 2 3 4 5 

22. It would be really great to win a prize in mathematics 1 2 3 4 5 

23. I see mathematics as a subject I will rarely use in my daily life as an adult 12 3 4 5 

24. Mathematics is a worthwhile and necessary subject 1 2 3 4 5 

25. I almost never get shook up during a math test 1 2 3 4 5 

26. If I had good grades in math, I would try to hide it I 2 3 4 5 

27. Once I start trying to work on a math puzzle, I find it hard to stop 1 2 3 4 5 

28. 1 can get good grades in mathematics 1 2 3 4 5 

29. Even though I study, math seems unusually hard for me 1 2 3 4 5 

30. Males are not naturally better than females in mathematics 1 2 3 4 5 

31. I'm not the type to do well in math 1 2 3 4 5 

32. ril need a firm mastery of mathematics for my future work 1 2 3 4 5 

33. I am usually at ease during math tests I 2 3 4 5 

34. When a question is left unanswered in math class, I continue to think about it 

afterward I ^ ^ 5 

35. Formal mathematics has little or nothing to do with everyday problem solving. 12 3 4 5 

36. I have a lot of self-confidence when it comes to math I 2 3 4 5 

37. I get a sinking feeling when I think of trying hard math problems 1 2 3 4 5 

38. Being regarded as smart in mathematics would be a great thing 1 2 3 4 5 

39 Math problems are always solved in less than 10 minutes if they are solved 

at all 1 2 3 4 5 

40. I will use mathematics in many ways as an adult I 2 3 4 5 

4L I am usually at ease in math classes 1 2 3 4 5 

42. Only geniuses are capable of discovering or creating mathematics 1 2 3 4 5 

43. People would think I was some kind of a nerd if I got A's in math 1 2 3 4 5 

44. I am challenged by math problems that I can't understand immediately. 1 2 3 4 5 

45. It is feminine for a girl to ask for help on a math problem 1 2 3 4 5 

Student Background 

1 . Indicate the total number of years of high school courses (in grades 9 through 12) you have taken in 

each of the subjects listed below. If you have not taken any course in a subject mark "0". If one or 
more of the courses is Advanced Placement, accelerated or honors, circle '*H" next to the number of 
years. 
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Arts and Music (for example, art. music, art history, dance, theater) H 

English (for example, composition, grammar, or literature) H 

Foreign and Classical Languages H 

Mathematics H 

Natural Sciences (for example, biology, chemistry, or physics) H 

Social Sciences and History (for example, history, govemment, or geography) H 



In questions 2-5, using the same guidelines as in question 1. indicate the total number of years you have 
taken the specific courses listed. 

2. Foreign and Classical Languages 

French 

German 

Greek 

Hebrew 

Italian 

Latin 

Russian 

Spanish 

Other language courses 

3. Mathematics 

Algebra 

Geometry 

Trigonometry 

Precalculus 

Calculus 

Computer Math 

Other mathematics courses 

4. Natural Sciences 

Biology 

Chemistry 

Geology or related Earth or Space Sciences 

Physics 

Other science courses 

5. Social Sciences and History 

U.S. History 

U.S. Government or Civics 

European History 

World History or Cultures 

OC 

26 



Ancient History 

Anthropology 

Economics 

Geography 

Psychology 

Sociology 

Other social sciences or history courses 

6. Please enter the average grade lor all courses \ou have already taken in each subject. 

Arts and Music 

English 

Foreign and Classical Languages 

Mathematics 

Natural Sciences 

Social Sciences and History 

For questions 7 through 9, please check any of the following areas which were covered in \our high school 
courses and related activities out of class. Check the areas you ha\e studied or participated in (\ou may 
mark more than one in each subject area). 

7. English course ^vork or experience 

American Literature 

British Literature 

Composition 

Grammar 

Literature of a country other thai, the L'.S. or Britain 

Literature of diftcrent historical periods 

Speaking and listening skills 

English as a second language 

8. Art and Music course work or experience 

I have had no course work or experience in this area 

Acting or the production of a play 

Art history or art appreciation 

Dance 

Drama or theater for appreciation 

Music history, theory, or appreciation 

Photography or filmmaking 

Studio art and design 

9. Computer course work or experience 

I have had no course work or experience in this area 

CiMTipuier literacy, awareness or appreciation 
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Data processing 



Computer programming (BASIC, COBAL, FORTRAN, PASCAL, etc.) 

Use of the computer to solve matii problems 

Use of the computer to solve problems in the natural sciences 

Use of the computer in English courses 

Word processing (use of the computer in writing letters or preparing papers) 

10. Please indicate your cumuiative grade point average for ail academic subjects in high school (circle 
one). 



A + 


(97-100) 


C-f 


(77-79) 


A 


(93-96) 


C 


(73-76) 


A- 


(90-92) 


C- 


(70-72) 


B + 


(87-89) 


DH- 


(67-69) 


B 


(83-86) 


D 


(65-66) 


B- 


(80-82) 


E or F 


(below 65) 



1 1 List the grades in which you participated in the activities listed below. If you held a major office 
or position of leadership in an activity (for example, class president, varsity team captain, officer of 
a statewide organization), circle **C" next to the grade number. Remember to include activities and 
accomplishments that are not school sponsored as well as your extracurricular activities. 

If you have received an award or special recognition for achievement in an activity (for example, 
school prize for music or writing, varsity letter, regional science fair prize, state orchestra), circle *'A" 



next to the grade number. 

Academic honor society q yi^ 

Art activity q 

Athletics: Intramural, junior varsity, or community C A 

Athletics: Varsity or amateur-level q A 

Career-oriented activity (for example. Future Teachers of America, Future Farmers 

of America) q 

Community or service activity (for example, volunteer work, neighborhood clean-up 

or patrol group. Scouting, Key Club) q /y 

Computer activity (for example, a user's group, computer club, learning to use a 

computer on your own) q 

Dance activity q yj^ 

Debating or public speaking q ^ 

Ethnic or cross-cultural activity (for example. Black student organization, Hispanic 

club, international folk dancing) q 

Foreign exchange or study abroad p:ogram C A 

Foreign language activity q 

Government or political activity (for example, student government, honors 

council, working on a political campaign, human rights or civil rights activity in 

your community) q 

Journalism or literary activity (for example, creative writing, yearbook, school 

newspaper, community newspaper) q \ 

Junior Reserve Officers Training C A 



Music: Instrumental (for example, high school band, community orchestra, 

solo work) 

Music: Vocal (for example, glee club, chorus, solo work) 

Religious activity or organization 

Science or mathematics activity (for example, math club, ecology or environmental 
group, science fair project) 

School-spirit activity (for example, checrleading, drill team) 

Theater activity (for example, community or school production, acting, stage 
crew) 

Work: Cooperative work program 

Work: Part-time job, not school related 

Other activity not listed (list below) . . 



1 have not participated in any of the above activities C A 

12. What is the highest level of education you plan to complete beyond high school? (Mark only one.) 

Specialized training or certificate program 

Two-year associate of arts or sciences degree 

Bachelor's degree (such as BA or BS) 

Master's degree (such as MA, MBA, or MS) 

Doctoral or related degree (such as PhD, JD, MD, DVM) 

Other 

Undecided 

13. What is your first choice of college major? (list below) 



.C A 
.C A 

-C A 

-C A 

r A 



.C A 
C A 
.C A 

.C A 



14. How certain are you about your first choice of major? 

Very certain 

Fairly certain 

Not certain 

15. List up to two other majors or areas of study that interest you. 

1) — 

2) ^ • ^ 

16. Mark each subject area in which you plan to apply for advanced placement, credit by examination, or 
exemption from courses. 

Art 

Biology • 

Chemistry 

Computer Science 
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English 

Foreign Languages 

Humanities 

Mathematics 

Music 

Physics 

Social Studies 

I don't plan to apply for exemption from these courses 

17. Mark each activity you may want to take part in while in college. 

Art 

Athletics: Intramural sports 

Athletics: Varsity sports 

Community or service organization 

Cooperative work or internship program 

Dance 

Debating or public speaking 

Departmental organization (club within my major) 

Drama or theater 

Environmental or ecology activity 

Ethnic activity 

Foreign study or study abroad program 

Fraternity sorority, or sor-al club 

Honors program or independent study 

Journalism or literary activity 

Music: Instrumental performance 

Music: Vocal performance 

Religious activity 

Reserve Ofticers Training Corps (ROTC, AFROTC, or NROTC) 

Student government 

18. How do you compare with other people yourown age in the following three areas of ability? 
Mathematical ability 

Among the highest 10 percent Above average 

Average Below average 



Scientific ability 

Among the highest 10 percent Above average 

Average Below average 



Writing ability 

— . — Among the highest 10 percent Above average 

Average Below average 



19. How would you descrihe yourself? (Mark all thai apply.) 

American Indian or Alaskan native 

Asian, Asian American, or Pacific Islander 

Black or African American 

Hispanic background: 

Mexican American or Chicano 

Puerto Rican 

Latin American. vSoulh American, Central American, or other Hispanic 

White 

Other 



20. Indicate the highest level of education completed by \ OLir father (or male uuardian) and your mother 
(or female guardian). Circle "F" to indicate faihcr and * M" to indicate mother. 



Grade school 


F 


M 


Some high school 


F 


M 


High school diploma or equivalent 


F 


M 


Business or trade school 


F 


M 


Some college 


F 


M 


Associate or two-year degree 


F 


M 


Bachclor\ or four- year degree 


F 


M 


Some graduate or professional school 


F 


M 


Graduate or professional degree 


[' 


M 



21 . What was the approxiniate combined income of your parents before taxes last year? 
Less than S1(),0()() 

About SIO.OOO to $20,000 

About S2(),000 to S3().0()() 

About S3(),()00 to $4().(K)() 

About S4().000 to S^O.OOO 

About S50,0()0 to Sf)().(K)0 

About S6O,0(X) to $70.(K)0 

More than S70,0(K) 



22. Please list your present grade and age. 
Grade Age 



23. When was the last time you took the SAT? 
Year Spring Fall (circle one). 

24. How many times have you taken the SAT? 

Please write "yes"' or "no" after each of the following questions. 

25. Did you take a test preparation course outside of school before taking the SAT (for example, the 
Princeton Review, or Kaplan)? 

26. Did you take a test preparation course provided by your school? 

27. Did you practice for the lest on your own? 
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APPENDIX D: BACKGROUND VARIABLES AND CORRELATIONS BETWEEN 
SAT-M OR STRATEGY AND QUESTIONNAIRE ITEMS 



Background Variables for Subjects Participating in Protocol Study 





ETHNICITY 




SELF-RATINGS OF ABILITY 




Race 


Males 


Females 














Mathematics 






5 


ability 


Miiles 


Females 


White 


16 


16 


lOp 1 U fC 




18 


Utner 




C) 


Above Avg. 




3 


Total 


23 


21 


Total 


23 




21 




. vGE 




Science ability 


Males 


Females 


Age 


Males 


Females 


Top I07r 


13 




15 


0 


1 


Above Avg. 


7 


7 


16 


4 


1 




3 








Average 


4 


17 


13 


17 










Total 


23 


21 


18 


A 


2 








Total 


23 


21 


PARENTS' EDUCATION 










Father 


Males 


Females 




GRADE 
















Business/Trade School 


1 


0 


Grade 


Males 


Females 


Some College 




0 


1 


10 


0 


1 


B.A. {4-yr. degree) 


8 


4 


11 


5 


6 


Some Grad. School 


3 


1 


12 


18 


14 


Grad./Prof. Degree 


10 


16 


Total 


23 


21 


Total 


23 


21 




TEST PREPARATION 




Mother 


Males 


Females 








H.S. Diploma 


0 


I 


Type 


Males 


Females 


Business/Trade School 


I 


1 


Outside School 


7 


6 


Some College 


3 


1 


At School 


3 


3 


B.A. (4-yr. degree) 


8 


9 


At Home 


15 


15 


Some Grad. School 


2 


2 


Total* 


25 


24 


Grad./Prof. Degree 


8 


7 


* Categories are not mutually exclusive 




Total 


22 


21 



32 



INCOMH 





Males 


F'enialcs 


SIO OOO-S'^O 0(K) 


1 


0 


000-S30 000 


1 


0 


000- S40 000 


1 


0 


S40 000-SSO 000 


1 


0 


$50,000-S60,000 


2 


0 


S6(),0(X)-S70,000 


I) 


1 


> S70,()()0 


10 


16 


Total 


16 


17 


HIGHEST I.EVHL OF EDUCATION PLANNED 
Level Males Females 


B.A./B.S. 


0 


-) 


M.A,/M.B.A,;M.S. 


9 


5 


PhT3./J,D,'M.D. 


12 


10 


Undecided 


2 


5 


Total 


23 





COLLEGE MAJOR 



Major 


Males 


Females 


Architecture 


0 


1 


Biochemistry 




0 


Bio. /Earth Sciences 1 i 


Chemistry 1 1 


Economics/Business 


0 


5 


Engineering 




2 


English/Writing 


1 


3 


History 


0 


1 


International Rel. 1 1 


Languages 


0 


1 


Mathematics 


1 


1 


Physics 


2 


0 


Pre-medicine 


-) 


0 


Total 


16 


17 
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Pearson Correlation Coefficients of 
Questionnaire Itenr^s with SAT-M Score 



Total 

Group Males Females 



Test-Taking Strategies* 

I usually leave several problems unanswered. -f .53 + .63 - 

/;<.() I p<X)2 

I usually guess at the answer when I can eliminate one oi* the options. - ,46 - .70 - 

p < .01 /; < .01 

Attitudes 

Generally I have felt secure about + .39 - - 

attempting mathematics. p < .04 

Irwouldn't bother me at all to take more math courses. -f .45 - - 

p < .02 

Mathematics is enjoyable and stimulating to me. -f .45 - -f .53 

p < .02 p< .05 

When a math problem arises that 1 can't immediately solve, 1 slick with .48 + .61 - 
it until I have the solution. p < .()| p < .02 

1 have a lot of self-confidence when it comes to math. + .47 - - 

p < .01 

Math problems are always solved in less than 10 minutes if they are - .42 

solved at all. p < .03 

I will use mathematics in many ways as an adult. - -f .60 

p < .03 

Background Variables* 

Number of high school courses in English. - .37 - - .54 

P < .05 /) < .04 

Number of high .school courses in foreign and classical languages. - - .57 - 

p < .04 

Number of high school courses in natural sciences. - - ' - .73 

p < .01 

Grades in English. - _ -f.52 

p < .05 

Years of participation in government or political activities. - - .79 - 

p < .02 

* High values indicate sironji ajireemem ujih the siaterncni. 



40 



Pearson Correlation Coefficients of 
Questionnaire Items with Algorithmic 
Strategy Use 



Total 

Group Males Females 



Test-Taking Strategies* 

I usually try to v/ork the problem out and then line! an answer that matches - .37 



-.51 



mine. 



p < ,05 p < .05 



.54 



Attitudes* 

1 don't like people lo think Vm smart in math. + 39 

p < .04 

I study mathematics because I know how useful it is. — .50 

/; < ,01 p< ,05 

Girls who enjoy studying math are a bit peculiar. — + ,59 - 

p < ,03 

Knowing mathematics will help me earn a living, - ,39 - - 

p < ,04 

Mathematics is of no relevance to my life, + ,50 - +52 

p < ,01 p < ,05 

Mathematics is a worthwhile and necessary subject, — - ,57 - 

p < ,04 

If I had good grades in math I would try to hide it, + ,55 + ,58 - 

/? < .01 p< .04 

Even though I study, math seems unusually hard for me, + ,43 - + .53 

p <,03 p < .05 

Being regarded as smart in mathematics would be a great thing. - ,51 - - ,76 

/;<,01 p<m 

Background Variables* 

Number of high school courses in mathematics, + ,52 - - 

p < .01 

Years of high school algebra. — + -63 - 

p < ,03 

Number of high school courses in English, - + .62 - 

p < ,02 

Number of high school courses in foreign and classical languages, - - + .59 

p < ,03 

Having taken a test preparation course outside of school. - - - .57 

p < ,03 

* High values indicate Nlrt)ng agreenienl v\iih the stateniciU. 
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